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ON THE TRADEOFF BETWEEN DRIFT AND VARIANCE 



By 

A. R. Washburn 



Naval Postgraduate School 
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January 1980 



ON THE TRADEOFF BETWEEN DRIFT AND VARIANCE 

by 

A. R. Washburn 

1 . INTRODUCTION 

A particle with fixed speed v that simultaneously 
wants to behave evasively and drift from one point to another in 
two dimensions has a conflict: If it drifts the maximum distance 
vt in a fixed time t, then it is forced to travel in an 
absolutely unevasive straight line. On the other hand, drift 
will not be maximal if the particle's motion is some sort of 
an evasive random walk. The purpose of this note is to report 
on an exploration of quantitative tradeoffs between these 
objectives. 

2 . PROBLEM FORJdULATION 

Let the positive x-axis represent the desired direction 
of drift, and suppose that the target goes from the origin to 





in 


. time t. 


Let 


x(t) = E(X^) 


and 


y ( t) = E (Y^) , let 


be 


the 


distance 


from 


(x(t) , y(t) ) 


to 


(X^,Y^) , and let 


be 


the 


distance 


from 


the origin to 


(X^, 


Y. ) . Let al = E(S^) 
t t t 



2 

be the measure of variance and x (t) be the measure of drift. 
Then 



(1) + x^(t) £ + x^(t) + y^(t) 

= E(X^ + Y^) = E(R^) < (vt) ^ 



1 



? 2 2 * 
From (1) , (vt) is an upper bound on + x (t) , and this 

upper bound will be nearly achieved if 



a) y(t) = 0 

b) the target's track is nearly a straight line, 

2 2 

since in that case E(R.) ~ (vt) 

t ~ 



For example, if the particle were to flip a coin to decide 

2 2 2 

whether its course should be 0 or -6, then + x (t) = (vt) , 

2 2 
with X (t) being largest when 0 is 0 and being largest 

when 0 is tt/ 2. The course should never be changed at any 

time; if there is any possibility of a course change in [0,t], 

then + x^(t) < (vt)^. 

The above analysis leaves one with a feeling of dissatis- 

2 . ... 

faction with the measure of variance a^, since maximization of 
2 2 

with a constraint on x (t) leads to the adoption of an 

intuitively unevasive motion. A tracker who saw the particle begin 

its motion would have no difficulty extrapolating the track if he 

ever lost contact; once the initial direction 0 is known, 

the particle's motion is deterministic. If the time origin were 

taken to be any time greater than 0, and if the prediction of 

future position were the conditional expectation given all past 

movements, then the particle's motion would not be evasive at all. 

2 

The above considerations lead to the adoption of s^ as 

2 

the measure of variance, where s^ is variance from the conditionaJ 
expectation of position given all past movements, averaged over 
all past movements. In order to simplify computation of s^. 
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assume that the particle's course is a stationary Markov stochastic 
process, in which case the predictive power of all past motion is 
the same as the predictive power of current course . There are 
many such processes, from which we select a discontinuous one 
and a continuous one for further study. The natural discontinuous 
process is a "random tour" [3], where the particle changes direction 
only at the jump points of a Poisson process. The natural con- 
tinuous process is the Ornstein-Uhlenbeck process, which is the only 

stationary Markov process that is normal. Figure 1 shows the ratio 

2 2 2 2 2 
s^/((vt) - X (t)) as a function of (x(t)/vt) , where s^ is in 

both cases maximal for the given value of x(t) . The rest of this 

paper consists of the computations lying behind Figure 1. Note 

that in both cases 

(2) s^ £ .381[(vt)^ - x^(t)] (0-U, random tour) 

An additional result is relevant. In [2], Grenander 

2 

formulates an analytic expression for s^ when the particle's 

course is any stationary process. The expression is in general 

very cumbersome, but in the special case where the process is 

normal and x(t) ~ vt, Grenander is able to exhibit the stationary 

2 2 

process (it is not Markov) that maximizes s^. The maximum s^ is 

(3) ®t " “T - x^(t)) = .405 ((vt)^ - x^(t)). 

TT 
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Evidently, the natural way to discuss the tradeoff 

between drift and variance is in terms of the ratio 
2 2 2 

= s^/((vt) -X ( t) ) . The maximum possible value of amongst 

all stationary processes is unknown, but it appears to be con- 
siderably smaller than 1.0, which is the bound obtained from 
equation (1) by observing that s^ £ 



4 



3. RANDOM TOUR CALCULATIONS 



Assxme without loss of generality that the particle's 

speed is v = 1.0. The particle is assumed to pick an independent, 

identically distributed sequence of courses 9^, from 

some distribution for which E(sin 9) = 0. Each course holds 

for a time that is exponential with mean 1/X , after which a 

2 

new course is adopted, etc. Let E(cos 9) = c^, E(cos 9) ^ 2 ' 

Xg(t) = E(X^I9^ = 9), yg(t) = E(Y^|9^ =9), v^(t) = E(X^), 

2 

v^{t) = E(Y^) and retain the definitions of x(t) and y(t) 
made earlier. Since 

(4) s^ = E([X^ - Xg(t)]^ + [Y^ - yg(t)]^) 

= v^(t) + v^Ct) - E(Xg(t) + yg(t)) , 

the functions that need to be determined are x„ (t) , y„ ( t) , 

y b 

Vj^(t) , and (t) . 

We know 



(5) E(Xg(t)) = x(t) = tc^ 

Let U be the time of the first course change, and let f(u) 
= X exp (-Xu) be the density function of U. Then 



(6) E (X^l 9^ = 9, U=u) 



u cos 9 + x(t-u) 
t cos 9 



if t 

if u > t 
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Therefore, by conditional probability. 



t 

(7) x-(t) = / [u cos e + x(t-u)] f(u)du + t cos 0 / f(u)du 

^0 t 

After performing the integrations, 

(8) XQ(t) = cos 0(1-(1+At) exp(-At))/A + x*f(t) +t cos 0 exp(-At)j 

where x*f(t) is the convolution of x(t) and f(t). Let 

X(s) , Xg(s), and F(s) be the Laplace transforms of x(t) , Xg(t), 

2 

and f(t), respectively. Then X(s) = c^/s and F(s) = A/(A+s). 
After cancelling t cos 0 exp (-At) in (8) and taking Laplace 
transforms of both sides, 

(9) AXg(s) = cos 0(l/s - l/(A+s)) + Cj^ A^/ (s^ (s+A)) 

Inverting the Laplace transform X. (s) , and letting 

z = At, 

(10) AXg(t) = cos 0(1 - exp(-z)) + c^(z - 1 + exp(-z)), 
or 

(11) AXg (t) = (cos 0 - Cj^) (1 - exp(-z)) + c^z . 

Squaring both sides of (11) and taking expected values, 

(12) A2E(x^(t)) = (C2 - c^) (1 - exp(-z))2 + 
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There are no cross product terms in (12) because S(cos 0 - c^^) = 0. 
2 

C 2 “ is just the variance of cos 6. A similar analysis shows 



(13) A^E(yg(t)) = (S 2 - s^) (1 - exp(-z))^ + sjz^ 



2 

where s^ = E(sin 6) = 0 and S 2 = E(sin 6) . Adding (12) and 



(13) and noting that C- + s- = 1, 



(14) A^E(xQ(t) + YQ(t)) = (1-cJ) (1 - exp(-z))^ + c^z^ 



We use a similar technique to obtain formulas for v ( t) 

X 



and Vy(t) . 



u c_ + 2uc^x(t“u) + V (t-u) if u < t 

^ 1 . X ■“ 



(15) E(X^|U=u) = 'I 



t^c. 



if u > t 



(16) ~ ^ ^ 2uc^x(t-u) + v^(t-u) ] f(u)du 



+ t^c» / f(u)du 



2 

After doing the integration, cancelling the t C 2 exp (-At) term, 
taking Laplace transforms, and simplifying. 
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(17) 



V (s) = 2c_/ (s^ (X+s) ) + 2c^X/ (s^ (X+s) ) , 

where Laplace transform of ‘ H^verting, 

z = Xt, 

9 2 2 2 

(18) X Vj^(t) = 2(c2 - c^)(z - 1 + exp(-z)) + z 
Similarly, 

(19) X^Vy(t) = 2 (s2 - s^)(z - 1 + exp(-z)) + z^s^ 

Substituting (14) , (18) , and (19) into (4) , 

(20) X^s^ = (1 - c^) (2z - 2(1 - exp(-z)) - (1 - exp(-z))^) 
or 

(21) sj = t^(l - c^) g(z) , 
where 

(22) g(z) = (2z - 2(1 - exp(-z)) - (1 - exp (-z) ) ^ ) /z^ 

The function g(z) has a maximum at z = 1.9, and 
g(1.9) = .381. Since t^(l-c^) = t^-x^(t), (21) is thus con 
sistent with (2) . Note that X should be set to make the 
number of turns in time t be 1.9, on the average. 



with 
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4 . ORNSTEIN-UHLENBECK CALCULATIONS 



The 0-U process 9^ is governed by two nuinbers a and 3 . 
The equilibrium distribution is normal with mean 0 and variance 
8 ? i .e . , 9^ ~ N (0 ,6 ) . From Feller [1] , 

(23) 9^ ~ N(p9^, 6 (1-p^) ) for u v 

where p = exp (-a (u-v) ) . The parameter a is thus a smoothing 

constant, with small values of a corresponding to smooth 

processes. In the following, we will repeatedly use the fact 

2 

that, if 9~N(y,a), then E (cos 9) = (cos y) exp(-a /2) and 

2 

E(sin 9) = (sin y) exp(-a /2) . 

The notation and plan are as in the random tour analysis; 

2 

i.e. we plan to employ (4) in obtaining an equation for s^. We 
first note that 

t t 

(24) x-(t) = E(/ cos 9 du) = / E(cos 9 ) du 

® 0 0 

Employing (23) with v = 0 and 9^ = 9 , 

t ^ 

(25) = / cos(p 9) exp (-8 (l-p„) /2) du , 

® 0 

where p^ = exp(-au) . Therefore, since 

b b b 

[ / (h(x)dx)]‘^= / / h(x) h(y) dx dy, 

a 3. 3. 
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(26) 



9 t t 2 

Xg(t) = / / cos (p^8) cosCp^e) exp (-S (1-p^) /2) 



X exp (-6 (1-p^) /2) dudv 



If cos is replaced by sin in (26) , the result is an expression 
2 

for yg(t). Using the fact that cos(p^9) cos (p^9) +sin (p^9) sin(p^i 
= cos ( (p^ - p^)9), we therefore have 

t t 

(27) x^(t) + ya(t) = / / cos((p -p )9) exp (-6 ( 2-p^-p^) /2) dudv . 

^ ^ 0 0 ^ ^ ^ ^ 

Since (p^-p^) 9 ~ N(0,6 (p^-p^) ^) , 

(28) E(xg(t) + yg(t) ) 

t t 2 o o 

= / / exp(-8 (p -p ) V2) exp(-S (2-p,>p;)/2)dudv , 

0 0 U V u V 

or 



(29) E(Xg(t) + yg(t)) 



t t 

= / / exp(-6[l - exp (-a (u+v) ) ] ) dudv 

0 0 



We turn next to computation of v (t) and v (t) . 
t AY 

Since X(t) = / cos 9 du , 

0 ^ 
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( 30 ) 



2 ^ ^ 

X (t) = / / COS 9 cos 9 du dv, 

0 0 ^ ^ 



If cos is replaced by sin in (30), an expression for Y'^(t) 

results. Since cos 9 cos 9 + sin 9 sin 9 = cos (9 - 6 ) , 

u V u V u V 



(31) 



2 2 t t 

X (t) + Y (t) = / / cos(9 - 9 ) du dv 

0 0 u V 



From (23), 9^ - 9^ ~N(-9^(l-p), 6 (1-p )) for u 21 *y. Since 
9^ ~ N(0,6 ) , 



(32) ®u ■ ®v N(0,6 (1-p)^ + 6 (1-p^)) 



for u > V , 



or 



(33) ~N(0, 26[l-exp(-a| u-v | ) ] ) 



Returning to (31), we finally obtain 
2 2 t t 

(34) E(X^(t) + Y^^(t)) = / / exp(-6[l - exp (-a I u-v I ) ] ) dudv 

0 0 



Substituting (34) and (29) into (4), one obtains a long 

2 

but nonetheless explicit formula for s^ as a function of a 
and 6 .* Since 
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I 



(35) x(t) = tE(cos 9) = t exp(-S/2) , 

2 ... 2 
maximizing for fixed x(t) is the same as maximizing s^ 

2 

for fixed S . The maximized s^, after being divided by 
2 2 

t - X (t) , is shown in Figure 1. Figure 2 shows the optimal 

2 2 2 

product at as a function of (x(t)/t) . Figure 3 shows s^/t 

as a function of at for 3=1, showing that it is better for 
the particle to make at too large than too small. 

Further ’analysis is possible in case 3 is very large or 
very small. After making a change of variable for |u-v| in (34) and 
for u + V in (29), the result is, with z = at 



(36) 



2/^2 

St/t 



= F(3 ,z) = 



4 

z 



dx 



/ 

0 



A (y) dy 



where 



(37) A(y) = exp[-3(l - exp(-y))] - exp[-3(l - exp(-2y))] 



When 3 is very small, 

(38) A(y) ~ 3 [exp(-y) -exp(-2y)] (small 3) 

2 

After integrating (38) twice and multiplying by (4/z ), one obtains 

(39) F(3,z) ~3g(z) , (small 3) 

12 



I 



where 


g ( z) 


is the 


same function as 


in the random tour analysis 


(eqn 


(22) ) . 


2 

Furthermore, since t 


x^(t) = t^(l - exp (-8)) ~ t\ 


when 


8 is 


small , 






(40) 




2//^2 

s^/(t 


- x^ (t) ) ~ g( z) 


( small 8 ) 


When 


8 is small, z 


should therefore 


be set to 1.9, in which 


case 


g ( z) = 


.381. 








Since 


lim o 
8 


F (8 , z) =0 for 


z > 0, the optimal z must 



approach 0 as 8 becomes large. Since 0£y£x£z in (36), 
y and x are small if z is. For small y, 

(41) A (y) ~ exp(-6y) - exp(-28y) (small y) 

2 

After integrating (41) twice and multiplying by (4/z ) , one obtains 

(42) F(8,z) ~ g(8z) (small z) 

where g(*) is once again the same function (22) . Therefore 

lim F(8, 1.9/8) = g(1.9) = .381; 

8 ^ oo 

2 2 

that is, the particle can make s^/t asymptotically .381 

2 2 2 

when 8 is large by making z = 1.9/8 . Since t and t - x ( t) 

2 2 2 

are asymptotically equal when 8 is large, s^/(t - x (t)) is also 

2 2 2 

asymptotically .381. Thus, the ratio s^/(t - x (t)) is bounded 

by .381 in all cases examined. 
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